Surgical instrument grounding for robot-assisted interventions
نویسندگان
چکیده
We present the first experimental framework for segmenting instruments in surgical scenes guided by natural language descriptions. Previous approaches rely exclusively on visual cues, thus ignoring...
منابع مشابه
Instrument Orientation-Based Metrics for Surgical Skill Evaluation in Robot-Assisted and Open Needle Driving
The technical skill of surgeons directly impacts patient outcomes. Advanced tracking systems enable the development of objective motion-based metrics for skill evaluation, but these metrics are not sufficient to evaluate the performance in complex surgical tasks. In this study, we developed metrics for surgical skill evaluation that are based on the orientation of the surgical instruments. Expe...
متن کاملAutomatic Instrument Segmentation in Robot-Assisted Surgery Using Deep Learning
Semantic segmentation of robotic instruments is an important problem for the robot-assisted surgery. One of the main challenges is to correctly detect an instrument’s position for the tracking and pose estimation in the vicinity of surgical scenes. Accurate pixel-wise instrument segmentation is needed to address this challenge. In this paper we describe our winning solution for MICCAI 2017 Endo...
متن کاملAutomated Tissue Retraction for Robot-Assisted Surgical Procedures
Robotic surgical assistants (RSAs) are enhancing physician performance, enabling them to perform more delicate and precise minimally invasive surgery (MIS). However, these devices are currently tele-operated and lack autonomy. In this paper, we focus on automating a relatively simple but commonly performed surgical task of tissue retraction, which involves grasping and lifting a thin layer of t...
متن کاملSymbol Grounding for Robot Dialog Research Proposal
Advancements in robotics have led to an ever-growing repertoire of software capabilities (e.g., recognition, mapping, and object manipulation). However, robotic capabilities grow, the complexity of operating and interacting with such robots increases (such as through speech, gesture, scripting, or programming). Language-based communication can offer users the ability to work with physically and...
متن کاملIndexical Grounding for a Mobile Robot
We have outfitted a mobile research robot with several sensors and algorithms designed to facilitate smalland large-scale navigation and natural language interaction. We begin with a parser using a large, hand-crafted English grammar and lexicon. We then add a standard gradient navigation algorithm for local obstacle avoidance, and a line segment comparison algorithm for basic, high-performance...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Computer methods in biomechanics and biomedical engineering. Imaging & visualization
سال: 2021
ISSN: ['2168-1171', '2168-1163']
DOI: https://doi.org/10.1080/21681163.2021.2002725